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Dynamics near and far away from thermal equilibrium is studied within the framework of Langevin 
equations. A stochasticity-dissipation relation is proposed to emphasize the equal importance of 
the stochastic and deterministic forces in describing the system's evolution and destination. It 
is a generalization of the fluctuation-dissipation theorem. Close to a stationary state an explicit 
construction of the potential energy is given through a gauged singular decomposition. Possible 
directions to extend the present study into generic situations are pointed out. 
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In biology, chemistry, and physics, a system under in- 
vestigation can often be well modeled by a set of deter- 
ministic differential equations.^ Those deterministic dif- 
ferential equations, describing phenomena on a macro- 
scopic level ranging from near to far from thermal equi- 
librium, are usually motivated by empirical observations. 
In addition, it is frequently found that adding the noise 
or stochastic force into them can result in a better de- 
scription of systems, or, enables investigators to get cer- 
tain desired results, such as particular stationary distri- 
butions. This is usually done in an ad hoc manner. The 
important question arises that whether or not the noise 
is an integral part of the mathematical modeling, such 
that the stochastic force has a transparent role and is 
directly connected to experimental observations. Ample 
experimental evidence from physics to biology, particu- 
larly the studies of the properties near thermal equilib- 
rium in chemistry and physics^ and of the evolution of 
species in biology'^, suggests the affirmative answer. In 
attempt to address this question, our first response may 
be to resort to a microscopic derivation under appropri- 
ate conditions. This would certainly be advantageous, 
because it shows the coherence between the macro and 
micro modeling. However, often in reality, apart from a 
heuristic justification, not only the microscopic deriva- 
tion is completely missing in a reductionist's point of 
view, the very existence of the corresponding microscopic 
base can be called into doubt. Even in a situation that 
such a microscopic base exists, as typically believed in 
physics, the derivation involves a careful consideration 
of the emerging properties and can be highly nontrivial. 
Therefore, granted the autonomy of the macroscopic de- 
scription, can we formulate the deterministic equations 
and the noise in a coherent manner? In this letter we will 
present an explicit construction leading to the positive 
answer. The presentation is inspired by the methodol- 
ogy of Onsager^ in his classical investigation of dynam- 
ics near thermal equilibrium. We have generalized On- 
sager's results in two important directions: We elevate 
the stochastic force to the position of equal importance 
to that of the deterministic equation, and explicitly con- 
struct the stationary distribution for the state variable 



in typical situations far away from thermal equilibrium 
where the detailed balance condition does not hold. 

To avoid the unnecessary mathematical complication, 
we will restrict the differential equations to be a set of 
first order ordinary differential equations. This corre- 
sponds to the homogeneous and well-stirred situation in 
a chemical reaction network widely encountered in biol- 
ogy and chemistry. Let the d component state variable 
be presented by x'^ — [xi, ...,Xd), a vector in d dimen- 
sional real space, the deterministic dynamical equation 
is 

x = f{x). (1) 

Here the superscript r denotes the transpose, the dot over 
the state variable denotes the derivative with respect to 
time t, X ~ dx/dt, and the n component force f'^{x) — 
{fi{x), ■■■,fd{x)) with fi{x) = fi{xi, ...,Xd), i = 1, is 
a smooth function specifying the evolution of the state 
variable in a deterministic manner. Eq.(l) is a short- 
hand writing for dxi/dt = fi{x), i = l,...,d.The force 
/ is specified by a set of controlling parameters which 
we will not further discuss in this letter, except we as- 
sume the force is explicitly time independent. The state 
variable can be the particle position in physics, or the 
concentrations of reactants in chemistry, or the protein 
expression levels in biology. There are two important fea- 
tures differ Eg.(l) from the usual Hamiltonian dynamics. 
First, the divergence of the force is finite except for a few 
isolated points: d-f^O, where d- f = J2i=i 9ifi{x), and 
di — d/dxi. The finite divergence implies that both the 
energy and the volume of phase space are not conserved. 
Second, the skew matrix dx f generated by the skew op- 
eration (9 X f)ij = difj{x) — djfi{x) is in general finite, 
too: 9 X / ^ 0. In two and three dimensions, d = 2,3, 
the skew operation reduces to the usual curl operation, 
V X , and the skew matrix can be represented by a vector. 
The finitcness of the skew matrix is a characteristic of the 
system far away from thermal equilibrium. It is believed 
that it can cause the absence of a potential^. We will, 
however, present an explicitly construction of a potential 
function. 
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To emphasize the essential idea of our method, we fur- 
ther simplify our problem by considering the dynamics 
near a stable point specified by zero force, / = 0. We 
will choose this stable point to be the origin in our d 
dimension state space. A stable point represents a sta- 
ble stationary state. Its existence is evident in chemistry 
and physics. In biology, where systems are believed to 
operate under the condition far away from thermal equi- 
librium, the existence of such a stable stationary state 
has also been demonstrated.^. Hence, to the linear order 
in X, the leading order close to the stable point x = 0, 
f = —Fx or /i = — J2'j=i F-ij^'j- Adding the noise, the 
stochastic force, into Eq.(l). we have 

x = -Fx + at) , (2) 

where the stochastic force C^(i) = (Ci(^)i Cd{t)), which 
is chosen to be represented by a Gaussian and white 
noise, with zero mean, < ({t) >= 0, and the variance 

<Cit)C{t')>=2DS{t-t') . (3) 

Here S{t) is the Dirac delta function and the constant dif- 
fusion matrix D is explicitly defined by < 0(^)0(^0 >= 
2DijS{t — t'). The average < ... > is carried out in the 
distribution function for the noise, not in terms of distri- 
bution function for the state variable. Unless explicitly 
specified, whenever it can be defined, the temperature in 
the present letter is always set to be 1: ksT = 1. This 
is equivalent to a rcscalc of energy. To ensure the in- 
dependence of all components of the state variable near 
the stable point, we will require the determinant of the 
constant force matrix F to be finite: det(F) ^ 0. We 
will call Eq.(2) the standard Langevin equation, or, the 
standard form of the stochastic differential equation.''"^ 
Now, we assert that there exists a transformation, such 
that we can transform Eq.(2) into the following form: 

(S + A)x ^ -duix) + at) , (4) 

with following properties: 5 is a constant symmetric and 
semi-positive matrix, A a constant antisymmetric ma- 
trix, and u(x) a single valued scale function to be speci- 
fied below. The stochastic force a{t) = {a{t), ■■■,^d{t)) 
is Gaussian and white and has the same origin as that 
of . Wc further require that the determinant of 
5 -|- A is finite, det(A + 5) 7^ 0, for the same reason of 
requiring det(F) / 0. Wc will call such a transformation 
from Eq.(2) to (4) the singular decomposition. Clearly, 
the symmetric matrix S plays the role of friction, and 
the antisymmetric matrix A the role of 'magnetic' field: 
'Energy' dissipation is always non-negative, x'^Sx > 0, 
and the transverse force, a 'Lorentz' force, does no work, 
x'^ Ax = 0. The function u{x) hence acquires the meaning 
of potential energy. While given Eq.(4) a unique Eq.(2) 
can be obtained, we point out that if the stochastic forces 
would be ignored, that is, C(^) = S,{t) = 0, the singular 
decomposition would not be unique. There would exist a 
family of singular decompositions transforming Eq.(2) to 



(4) . One would be easily able to verify this observation by 
multiplying an arbitrary finite constant to Eq.(4): a large 
friction and a large potential has the same deterministic 
dynamics of a small friction and a small potential. Thus 
for the same deterministic dynamics specified by Eq.(l) 
( at) = in Eq.(2) ), the underlying system properties 
such as the energy dissipation determined specified by 
Eq.(4) with at) = would be totally different. This ob- 
servation strongly indicates that the stochastic force is 
an integral part of the system's dynamics: the stochas- 
tic force introduces an intrinsic scale into the problem. 
Specifically, requiring the uniqueness of the singular de- 
composition, we impose the following condition which 
links the stochastic force to the dissipation matrix: 

<at)ait')>=2ss{t-t') . (5) 

Together with < ^(i) >= 0, Eq. (5) will be called 
the stochasticity-dissipation relation, and Eq.(4) will be 
called the normal Langevin equation, or, the normal form 
of the stochastic differential equation. The singular de- 
composition under this stochasticity-dissipation relation 
will be called the gauged singular decomposition. 

By our construction, the same dynamics is described 
by either the standard Langevin equation, Eq.(2), or, the 
normal Langevin equation, Eq.(4). Eliminating x from 
those two equations leads to 

(S + A) [-Fx + at)] = -du{x) + at) ■ (6) 

Because the stochastic forces come from the same source, 
and their dynamics is independent of that of the state 

variable, separately we have (S + A)Fx — Ux, where we 
have set du{x) = Ux, and {S -\- A)at) = 5(0- Since x 
can be an arbitrary state vector, we have 

{S + A)F = U . (7) 

Using Eq.(5) and < {S + A)at)C {t'){S - A) >=< 
at)a{t') >, we obtain the following generalized Einstein 
relation between the diffusion matrix D and the friction 
matrix S: 

{S + A)D{S -A) = S. (8) 

Eq.(8) suggests a duality between the standard and the 
normal Langevin equations: large friction matrix implies 
small diffusion matrix, and vice versa. 

Wc next prove the existence and uniqueness of the 
gauged singular decomposition by an explicit construc- 
tion. Using the fact that the potential matrix U is sym- 
metric as required by 9 x du{x) = 0, we have 

{S + A)F-F''{S-A) = 0. (9) 

Defining an auxiliary matrix G = {S + A)~^ , the gener- 
alized Einstein relation, Eq.(8), and the above equation 
lead to the following two coupled inhomogeneous linear 
equations for G and its transpose: 
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GF^ - FC = , 



(10) 



Jo (a;) = 



(17) 



and 

G + G^ = 2£>. (11) 

The symmetric part of the auxihary matrix G is read- 
ily available from Eq.(ll). Equations similar to Eq.(ll) 
have been discussed Before in the context of Ornstein- 
Uhlenbeck process'^"^'' The antisymmetric part, Q = 
{G — G'^)/2, can be formally expressed as a series after a 
straightforward matrix manipulation: 

oo 

g = ^(-l)"[F-"£)(i?'^)" - i?'"Z)(F^)-"] . (12) 

n=l 

Having obtained the auxiliary matrix G in terms of the 
force matrix F and the diffusion matrix D, G = D + Q, 
the gauged singular decomposition is uniquely deter- 
mined: 

r U = G-^F 

) S = [G-i + (G^)-i]/2 . (13) 
[ A = [G-i - (G-)-V2 

The potential energy is u{x) = x'^Ux/2. This completes 
our proof of the existence and uniqueness of the gauged 
singular decomposition. 

With the energy function in the present problem as the 
potential energy u{x), the stationary distribution func- 
tion po{x) for the state variable should be given by 

Po{x) = ^ cxp{-M(a;)} , (14) 

with the partition function Z = J d'^x exp{— w(a;)}. The 
normal Langevin equation, Eg. (4), allows a particular 
easy identification of the energy function. Without the 
stochastic force, no energy can be uniquely defined from 
Eq.(l) or Eq.(2), and the singular decomposition is not 
unique, too. The available volume of phase space for the 
state variable would be shrank to zero, to a point defined 
by the stationary state. 

From either the standard or the normal Langevin equa- 
tions, it is straightforward to obtain the correspond- 
ing Fokker-Planck equation for the distribution function 
P{x,t) of state variable^: 

dtP{x, t)+d-[{f- Dd)P{x, t)] = 0. (15) 

Here dt = d/dt. If the probability current density is de- 
fined as J{x,t) = if - Dd)P{x,t), the Fokker-Planck 
equation is a statement of the probability continuity: 
dtP{x,t) + d ■ J{x,t) = 0. The stationary state corre- 
sponds to the condition 

d ■ Jo{x) = . (16) 

Particularly, the condition 



has been called the detailed balance condition. ^'"^^^ One 
can check that the stationary distribution Po{x) in 
Eq.(14) is indeed the time independent solution of the 
Fokker-Planck equation: The stationary probability cur- 
rent Jo{x) = -GAG'^Ux Pq{x) &ndd-Jo{x) = 0. Unless 
the transverse matrix A is zero, the detailed balance con- 
dition does not hold. This suggests a natural description 
of a stationary cyclic motion by the normal Langevin 
equation. 

One comment is in order: The uniqueness of the 
gauged singular decomposition is guaranteed by the con- 
ditions det(F) ^ and det(5 + A) ^ 0, which leads 
to the Gaussian distribution for the stationary distribu- 
tion for state variable. Hence near thermal equilibrium 
the stochasticity-dissipation relation is equivalent to the 
fluctuation-dissipation theorem. Nevertheless, in the 
normal Langevin equation no assumption is made on the 
underlying thermal dynamics. The real difference is that 
by the stochasticity-dissipation relation the emphasis is 
on the stochastic force, therefore on dynamics, and by the 
usual fluctuation-dissipation theorem the emphasis is on 
the stationary state distribution, therefore on statics. In 
this sense one may regard the stochasticity-dissipation 
relation as a generalization of the fluctuation-dissipation 
theorem. 

To further illustrate the coherence and generality of 
the present method, we discuss three aspects of the nor- 
mal Langevin equation and the gauged singular decom- 
position. We first look further into the detailed balance 
condition. In order to have the stationary probability 
current Jo{x) = 0, the necessary and sufficient condition 
is the transverse matrix to be zero: ^ = 0. This is equiv- 
alent, according to Eq.(13), G = G^ . It follows that both 
the matrix U F and matrix SF are symmetric. For a sym- 
metric force matrix F, this further leads to the condition 
SF = FS, that is, S and F commute. This implies that, 
even for a symmetric force matrix F, not every choice of 
the friction matrix S, therefore the potential matrix U, 
can guarantee the detailed balance condition. 

Second, we consider four examples from four differ- 
ent fields, where either the force matrix F is explicit 
asymmetric or the transverse matrix A is finite. They 
belong to two special but important classes where the di- 
rect connection between the deterministic force and the 
stochastic force can be established microscopically. The 
first example is well-known in physics: the charged par- 
ticle moving in a magnetic field, the magneto-transport 
in solid state physics. The second example is the emer- 
gent vortex dynamics in superfluids and superconductors, 
whose microscopic derivation is vciry technical. When 
the damping is strong enough, the equation of motions 
are already in the form of normal Langevin equation. For 
both cases at two dimension, li = 2, we can identify the 
friction and transverse matrices as: 
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In both cases the friction and stochastic force can be 
formulated as the results of the coupling between the 
system and a reservoir. The stochastic dynamics can be 
formulated within the Hamiltonian framework cherished 
in physics. -"^^ Dynamical equations already in the form of 
standard Langevin equation are the Lotka-Volterra equa- 
tion for species competition^, and the toggle equation for 
the stability of gene switch^^, our third and fourth exam- 
ples. In the corresponding force matrix F 



Fi2 7^ 



21 



(19) 



The Lotka-Volterra and toggle equations describe pro- 
cesses belong to the generic predator-prey or growth- 
decay process, where the diffusion matrix D can be ob- 
tained based on the knowledge of the deterministic equa- 
tion when large number of birth and death events occur 
on the macroscopic time scale. ^^''^'^ 

In most cases, however, both the intrinsic and the ex- 
trinsic noise coexist. They are equally important and 
can be determined experimentally.^^ The stochasticity- 
dissipation relation treats them on the equal footing to 
determine the gauged singular decomposition. Quanti- 
tative and global predictions can be made based on the 
normal Langevin equation. 

Finally, we consider the classical example of a damped 
harmonic particle in one dimension to illustrate the con- 
sistency of our method. The celebrated equation of mo- 
tion for momentum p and coordinate q is^~^ 



q = p/m 

p = —r]/mp — kq + (^{t) 



(20) 



Here < C{t) >= and < C(OC(i') >= 27?(5(t - t'), m 
is the mass of the particle, and k the spring constant. 
The equilibrium distribution function is^^^ Po(x) = 
1/Z exp{ — (p^/2m -f kq-^/2)}, because the total energy 
can be readily identified as E = p^ /2m -\- kq^ /2, the sum 
of kinetic energy and potential energy. Let x\ = q,X2 = 
p, the force matrix F and the diffusion matrix D can be 
easily identified as 



F = 



-1/m 
k ry/m 



D 





T] 



(21) 



By a straightforward calculation, the gauged singular de- 
composition consisting of the friction matrix S, the trans- 
verse matrix A and the potential matrix U is found as. 



U = 



k 
1/m 



,S = 



r] 




1 
-1 



(22) 



which gives the same energy function, as it should. 

In conclusion, we have explicitly constructed the nor- 
mal Langevin equation from the standard Langevin 
equation via a gauged singular decomposition. The 
fluctuation-dissipation theorem is generalized to the 
stochasticity-dissipation relation to emphasize the dy- 
namical nature of the stochastic force. We have obtained 



the potential energy which determines the stationary dis- 
tribution even when the detailed balance condition does 
not hold. Finally, we point out that the normal Langevin 
equation enables the generalization in several directions. 
It is straightforward to generalize the approach to unsta- 
ble fix points. Taking corresponding limits of the dimen- 
sion of the phase space goes to infinite, t may be applied 
to the stochastic partial differential equations. We note 
that it is already in the form ready for the color noise case 
as demonstrated in the study of the dissipative dynamics; 
and if we view the present construction as a local approx- 
imation, the extension to the generic nonlinear situation 
is implied. 
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